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VERTEX DATA PROCESSING WITH MULTIPLE THREADS OF EXECUTION 



The addressable and displayable basic element used to build up a computer image is 
a pixel. Each pixel has several essential parameters stored as the pixel's vertex data. Typical 
parameters are position data, such as an X coordinate, a Y coordinate and a Z coordinate, that 
indicate the pixel's reference position in three dimensions (3D); color information, such as 
diffuse color parameters (R D , G D , B D , A) and specular color parameters (R s , G s , B s , F) which 
form the pixel's diffuse color and specular color; texture information, such as the pixel's 
texture pattern and the depth of the pattern from the viewer; or any other suitable information 
needed by the specific individual application. Based on the graphic standards used by ah 
application, parameters may be stored in different orders or formats within the vertex data. 
For example, coordinate parameters may be stored as 32-bit floating-point format or fixed- 
point format. The color information parameters may be stored as a simple group of 4 bytes 
or as a complicated group of 16 bytes. The graphic device displays the pixel based on its 
vertex data parameters. 

Typical image display systems by using hardware and software have automated 
several primitive draw functions. For example as shown in Figure la, to draw a line, the 
application needs to provide only the beginning pixel point A 1 0 (X,, Y l9 Z x ) and the ending 
pixel point B 12 (X 2 , Y 2 , Z 2 ) to the graphic device 9. The graphic device 9 determines which 
pixels are on the line between pixel A 10 and pixel B 12. Subsequently, the graphic device 
9 sets up these pixels 1 color information using the A and B pixels' color parameters. If the 
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application wants to move the line to a new location, the new positions of A 10 will be A' 
14 (X,+a, Y+b, Z,) and B 12 will be B' 16(X 2 +a 3 Y 2 +b, Z 2 ). If a scaling factor c is involved, 
the new A' 14 pixel will be (x 1+ c+a, y 2 *c+b, z 2 ) and B' 16 will be (X 2 *c+a, Y 2 *c+b, Z 2 ). 

The same principle applies to drawing a triangle, another primitive function. An 
application provides vertex data that has parameters of the three triangle end points. The 
graphic device 9 will set up the vertex data of all relevant pixels to draw the triangle. All two 
dimensional (2D) or 3D graphic objects are made up of a number of polygons which can be 
broken into primitive functions, such as lines, triangles etc. To redraw 2D or 3D graphic 
objects requires redrawing the relevant primitives. The redrawing requires setting up all 
corresponding pixels' vertex data and redrawing them. All graphic operations, simple or 
complicated, are performed by manipulating the contents of pixel vertex data by 
multiplication, addition or logical operations, such as OR and exclusive OR. 

Users of personal computers or game systems utilize real-time effects on displayed 
images. In such systems, a 2D or 3D image is displayed at a rate of 30 or more frames per 
second. These rates allow the user to perceive continuous motion of objects in a scene. To 
achieve such a real-time, realistic and interactive image requires a tremendous amount of 
processing power. These effects require processing over a million graphic primitives per 
second. Typically, processing a million primitives requires multiplying and adding millions 
of floating-point and fixed-point values. 

Accordingly, it is desirable to improve the efficiency of transforming vertex data. 



# * 

ATI-000118BN 

SUMMARY 

Multi-thread video data processing for use in a computer video display system. The 
parameters of vertex data are grouped into a plurality of groups. The computation needs of 
each group are broken down into several arithmetic operations to be performed by 
5 corresponding arithmetic units. The units concurrently process the vertex data. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure la illustrates two displayed line images. 
Figure lb is the vertex data of the lines of Figure la. 

o 

q Figure 2 illustrates functional blocks of a setup engine. 

I JO Figure 3a is a table of the basic state operations for the position data group. 

Li Figure 3b is a state diagram for the position data group. 

^ Figure 4a is a table of the basic state operations for the color information group. 

^ Figure 4b is the state diagram for the color information group. 

i, ^ 

f 3 Figure 5a is a table of the basic state operations for the texture information group. 

5: ST 

. 35 Figure 5b is the state diagram flow chart for the texture information group. 

O 

□ Figure 6 illustrates the functional process flow for the transform engine. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Instead of using a traditional sequential processing approach, a multi-thread approach 
to process the vertex data may be used. As shown in Figures la and lb, computer monitor 
20 9 displays a first line with the beginning pixel point A 1 0 with parameters Xq, Y 0 , Z 0 , W 0 , S 0 , 
T 0 , C 0 and the end pixel point B 12 with parameters X b Y b Z l5 W b S l5 T x and C x stored as 
vertex data 20. That line may be modified. It may be moved to a new location, such as to 
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begin point 14 and end point 16. It may be scaled. It may have its specular color and texture 
pattern modified. One approach to redrawing the line is to process all parameters of vertex 
data 20 into new vertex data 40 before the new vertex data 40 is submitted for the line 
redraw. 

5 The transform process will be explained with reference to modifying a line f s pixel 

vertex data parameters. This transform process may be used for any transformation. As 
shown in Figure 2, the transform engine 67 is a part of a setup engine 65. Vertex data is 
transformed by the transform engine 67 and processed by the other data processing engine 
68. Subsequently, the transformed and processed data is sent to raster engine 69 prior to 

£3 

1 3 0 output to the monitor 9 . 

1. 1 ! 

f j The transform engine 67 initially groups vertex data parameters together for 

ill 

{ 1 processing. The groups allow for more efficient utilization of each arithmetic unit, such as 
" ^ a floating-point multiplication unit and a floating-point addition unit. One grouping scheme 
L groups: the pixel position vertex data, the pixel color vertex data and the pixel texture vertex 
^| 5 data together. To illustrate for a line, the pixels 1 position data Xq, Y 0 , Z 0 and W 0 and X l5 Y 1? 

Z, and Wj is selected as a first group. The pixels 1 color data C 0 and C x is selected as a second 
Q group and the pixels 1 texture data S 05 T 0 and S l5 T x is selected as a third group. By analyzing 
the computational requirements of each group, the required tasks can be broken down into 
addition and multiplication operations. The broken down operations are used to construct 
20 multiplication and addition state operations. Any computation needs of the group can be 
fulfilled by using the combination of its basic state operations to achieve the final results. 
Using sequential states, the addition unit may perform operations such as subtraction, move, 
floating-point number conversion to fixed number, truncate, round to even, round to odd. 
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To transform the position data group as shown in Figure 3 a, one approach is to use 
ten basic state operations 80-89. Six 80-85 out of the ten basic 80-89 state operations involve 
multiplication. Three state operations 86-88 involve addition and one state operation 89 is 
a wait, no operation (NOP), state operation. There is also an idle state 79. As shown in 
5 Figure 3 a, position state operation 0 80 involves multiplying the X coordinate by a scale 
factor. Position state operation 8 88 involves adding the Z coordinate with an offset. For 

vertex data of the initial line begin pixel A 10 (Xo,Y 0 , and Z 0 ) transforms to A, 14 (xd 

f3 =X 0 «c 1 +a 1 , Yo = Y 0 *c 2 +a 2 , Zo=Z 0 *c 3 +a 3 ). The transformation will require position state 

m operations (PSO) 0, 6, 1, 7, 2 and 8; 80, 86, 81, 87, 82 and 88 to complete the whole 

f jo computation. Referring back to Figure 3b, the different paths from one position state 

i rj operation to other position data state operations are shown. 

. T To transform the color data group, one approach is to use ten independent color state 

j;^ operations (CSO), as shown in Figure 4a. Each CSO involves only addition with one color 

^ = parameter. CSO 0-3 100-102 are related to diffuse color parameters addition, CSO 4-7 104- 

Q5 107are related to specular color parameters addition, and CSO 8-9 108-109 move the R, and 

I, -Z 

Rd vertex data. The move operation may be performed using an addition unit. The different 
paths from one color state operation to other color state operations are shown in Figure 4b. 
To transform the texture data group, one approach is to use eight texture state operations 
. (TSOs). Six 122-127 of the TSOs are multiplication related and two 120, 121 of the TSOs 
20 are moves which can be performed by addition. Figure 5a shows the different paths from 
one TSO 120-127 to other TSOs 120-127. 
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By grouping the vertex data into position, color and textural groups, multiple 
arithmetic units, such as a floating-point multiplication and a floating-point addition unit, 
may be utilized more efficiently. To illustrate, if position group data is utilizing the floating- 
multiplication unit to perform a multiplication operation, simultaneously an addition 
5 operation of either the color group or texture group can utilize the addition unit. By 
continuously sending multiplication and addition operations to queues associated with the 
multiplication and addition units, both the multiplication and addition unit are used with 
higher efficiency accelerating data processing. 

Each of these groups of operations comprise a "program", or "thread of execution" 

P 

s JO that vies for the use of the shared arithmetic resources. Multiple controllers are typically 
j j used, each executing a thread, that can generate a sequence of instruction for the shared 
H arithmetic resources. 

'"4 
- ^ 

"1: It is a common requirement that the vertex data processor be flexible enough, via 

^ programmability, to perform a certain subset of all of its possible operations, for any given 
i;3 5 graphics primitive or vertex. Since the exact operations to be performed by the transform 
engine are not known until run-time, it is desirable for the processor to respond dynamically 
p to the processing workload to efficiently use the available processing resources. One 
technique for dynamic processing is to group the operations based on which function unit 
they use. Subsequently, the operations are concurrently scheduled to each function unit. 
20 To illustrate as shown in Figure 6, the vertex data 140 is broken into three groups; 

position group 145, color group 1 50 and texture group 155. The position group 145 requires 
PSO 0, 6, 1, 7, 2 and 8; 80, 86, 81, 87, 82 and 88 to complete its data transformation. The 
color group 150 requires CSO 0 and 8; 100 and 108 to complete its transformation. The 
textural group 150 requires TSO 0 and 2; 120 and 122 to transform the textural parameters. 
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All multiplication state operations from the position or textural groups 145, 155 will be 
queued at the multiplication queue 160 and all addition state operations from all three groups 
145, 150, 155 will be queued at the addition queue 165. The queued operations of both 
queues 160,165 will be independently executed by the multiplier unit 1 70 and the adder unit 
175. The queues are controlled by schedulers, such as an M-scheduler 181 and A-scheduler 
182. 

In ^gftain circumstances, coordination between threads is needed. For example, 
intermediate resuh^from the position thread (for example, perspective-related information) 
ma^ be required by the"tes^ture thread. Binary or counting semaphore 180 can be used to 
synchronize the sequential execution of two different threads and to signal when the result 
from one thread is available for the nfext thread to consume. The results of the executed 
operations are sent to a post-processing engifrsJ 85, such as the XEOPIPE, which performs 
operations, such as rounding or conversion from flbs{ing-point to fixed-point format. The 
buffer 195 holds the transformed vertex data until requir^tisby other processes. 



